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Social computation, whether in the form of searches performed by swarms of agents or collective 
predictions of markets, often supplies remarkably good solutions to complex problems. In many 
examples, individuals trying to solve a problem locally can aggregate their information and work 
together to arrive at a superior global solution. This suggests that there may be general principles 
of information aggregation and coordination that can transcend particular applications. Here we 
show that the general structure of this problem can be cast in terms of information theory and 
derive mathematical conditions that lead to optimal multi-agent searches. Specifically, we illustrate 
the problem in terms of local search algorithms for autonomous agents looking for the spatial 
location of a stochastic source. We explore the types of search problems, defined in terms of 
the statistical properties of the source and the nature of measurements at each agent, for which 
coordination among multiple searchers yields an advantage beyond that gained by having the same 
number of independent searchers. We show that effective coordination corresponds to synergy and 
that ineffective coordination corresponds to independence as defined using information theory. We 
classify explicit types of sources in terms of their potential for synergy. We show that sources 
that emit uncorrelated signals provide no opportunity for synergetic coordination while sources that 
emit signals that are correlated in some way, do allow for strong synergy between searchers. These 
general considerations are crucial for designing optimal algorithms for particular search problems in 
real world settings. 



INTRODUCTION 

The ability of agents to share information and to coor- 
dinate actions and decisions can provide significant prac- 
tical advantages in real-world searches. Whether the tar- 
get is a person trapped by an avalanche or a hidden cache 
of nuclear material, being able to deploy multiple au- 
tonomous searchers can be more advantageous and safer 
than sending human operators. For example, small au- 
tonomous, possibly expendable robots could be utilized 
in harsh winter climates or on the battlefield. 

In some problems, e.g. locating a cellular telephone 
via the signal strength at several towers, there is often 
a simple geometrical search strategy, such as triangula- 
tion, which works effectively. However, in search prob- 
lems where the signal is stochastic or no geometrical so- 
lution is known, e.g. searching for a weak scent source in 
a turbulent medium, new methods need to be developed. 
This is especially true when designing autonomous and 
self- repairing algorithms for robotic agents [1]. Informa- 
tion theoretical methods provide a promising approach 
to develop objective functions and search algorithms to 
fill this gap. In a recent paper, Vergassola et al. demon- 
strated that infotaxis, which is motion based on expected 
information gain, can be a more effective search strategy 
when the source signal is weak than conventional meth- 
ods such as moving along the gradient of a chemical con- 
centration Q . The infotaxis algorithm combines the two 
competing goals of exploration of possible search moves 
and exploitation of received signals to guide the searcher 
in the direction with the highest probability of finding 
the source [3[. 



To improve the efficiency of search by using more than 
one searcher requires determining under what circum- 
stances a collective (parallel) search is better (faster) 
than the independent combination of the individual 
searches. Much heuristic work, anecdotally inspired by 
strategies in social insects and flocking birds |4|, [5| , has 
suggested that collective action should be advantageous 
in searches in real world complex problems, such as for- 
aging, spatial mapping, and navigation. However, all 
approaches to date rely on simple heuristics that fail 
to make explicit the general informational advantages of 
such strategies. 

The simplest extension of infotaxis to collective 
searches is to have multiple independent (uncoordinated) 
searchers that share information; this corresponds in gen- 
eral to a linear increase in performance with the num- 
ber of searchers. However, given some general knowledge 
about the structure of the search, substantial increases 
in the search performance of a collective of agents can 
be achieved, often leading to exponential reduction in 
the search effort, in terms of time, energy or number of 
steps [6-8]. In this work we explore how the concept of 
information synergy can be leveraged to improve info- 
taxis of multiple coordinated searchers. Synergy corre- 
sponds to the general situation when measuring two or 
more variables together with respect to another (the tar- 
get's signal) results in a greater information gain than 
the sum of that from each variable separately 0, E3| • We 
identify the types of spatial search problems for which 
coordination among multiple searchers is effective (syner- 
getic), as well as when it is ineffective, and corresponds to 
independence. We find that classes of statistical sources, 



2 



such as those that emit uncorrelated signals (e.g. Pois- 
son processes) provide no opportunity for synergetic co- 
ordination. On the other hand, sources that emit parti- 
cles with spatial, temporal, or categorical correlations, do 
allow for strong synergy between searchers that can be 
exploited via coordinated motion. These considerations 
divide collective search problems into different general 
classes and are crucial for designing effective algorithms 
for particular applications. 



R(Xi, X 2 , X$) < 0, more information is available when 
these variables are considered together than when con- 
sidered separately. In this case X\ and X 2 are said to be 
synergetic with respect to X3. If R(X\, X 2 , X 3 ) — 0, Xi 
and X 2 are independent 0, [uj ■ 



Two-dimensional spatial search 



INFORMATION THEORY APPROACH TO 
STOCHASTIC SEARCH 



Effective and robust search methods for the location of 
stochastic sources must balance the competing strategies 
of exploration and exploitation |3|. On the one hand, 
searchers must exploit measured cues to guide their opti- 
mal next move. On the other hand, because this informa- 
tion is statistical, more measurements need to typically 
be made that are guided by different search scenarios. 
Information theory approaches to search achieve this bal- 
ance by utilizing movement strategies that increase the 
expected information gain, which in turn is a functional 
of the many possible source locations. In this section we 
define the necessary formalism and use it to set up the 
general structure of the stochastic search problem. 



Synergy and Redundancy 

First we define the concepts of information, syn- 
ergy and redundancy explicitly. Consider the stochas- 
tic variables Xi,i = 1 . . . n. Each variable Xj, can take 
on specific states, denoted by the corresponding low- 
ercase letter, that is X can take on a set of states 
{x}. For a single variable X the Shannon entropy 
(henceforth "entropy") is S(X) = -J2 x p ( x ) l og 2 P(x), 
where P(x) is the probability that the variable X take 



on the value x The entropy is a measure of 



uncertainty about the state of X, therefore entropy 
can only decrease or remain unchanged as more vari- 
ables are measured. The conditional entropy of a vari- 
able Xi given a second variable X 2 is S(X 1 \X 2 ) — 
-Y. XuX2 P{xi,X2)\og 2 {P{x 1 ,x 2 )/P{x 2 )) < SiX,). The 
mutual information between two variables, which plays 
an important role in search strategy, is defined as 
the change in entropy when a variable is measured 
I(X X ,X 2 ) = S(Xx) - S(Xx\X 2 ) > 0. These defini- 
tions can be directly extended to multiple variables. 
For 3 variables, we make the following definition 12j : 
R(X 1 ,X 2 ,X 3 ) ee I(Xt,X 2 ) - I({X U X2}\X 3 ). This 
quantity measures the degree of "overlap" in the infor- 
mation contained in variables X\ and X 2 with respect 
to X 3 . If R(Xi,X 2 ,X 3 ) > 0, there is overlap and X\ 
and X 2 are said to be redundant with respect to X 3 . If 



We now formulate the two-dimensional stochastic 
search problem. We consider, for simplicity, the case 
of two searchers seeking to find a stochastic source lo- 
cated in a finite two-dimensional plane. This is a gen- 
eralization of the single searcher formalism presented in 
Ref. Q. At any time step, the searchers have positions 
{ri}, i — 1,2 and observe some number of particles {hi} 
from the source. The searchers do not get information 
about the trajectories or speed of the particles; they only 
get information if a particle was observed or not. There- 
fore simple geometrical methods such as triangulation 
are not possible. Let the variable Rq correspond to all 
the possible locations of the source r$. The searchers 
compute and share a probability distribution PW(ro) 
for the source at each time index t. Initially the prob- 
ability for the source is assumed to be to be uniform. 
After each measurement {hi,ri}, the searchers update 
their estimated probability distribution of source posi- 
tions via Bayesian inference. First the conditional prob- 
ability P( t+1 \rv\{h liri }) = pW(r )P({/i i) ri }\r )/A, is 
calculated, where A is a normalization over all possi- 
ble source locations as required by Bayesian inference. 
This is then assimilated via Bayesian update so that 
F(*+ 1 )(r )EEP(*+ 1 )(r |{/ ll ,r l }). " 

If the searchers do not find the source at their present 
locations they choose the next local move using an in- 
fotaxis step to maximize the expected information gain. 
To describe the infotaxis step we first need some defini- 
tions. The entropy of the distribution P^(tq) at time 
t is defined as S^(R Q ) = - J2 r « p[t) ( r o) log 2 P [t) M- 
In terms of a specific measurement {hi,ri} the en- 
tropy is (before the Bayesian update) S$, r .^(Ro) = 
-EroP^irolih^nVlogzPWirollhun}). "we define 
the difference between the entropy at time t and the en- 
tropy at time t + 1 after a measurement {hi,ri} to be 
AS* 



(t+i) 



'{hi,n} 

Initially the entropy is at its maximum for a uniform 
prior: S^(Ro) = \og 2 N s , where N s is the number of 
possible locations for the source in a discrete space. For 
each possible joint move {r^}, the change in expected 
entropy AS is computed and the move with the minimum 
(most negative) AS is executed. The expected entropy 
is computed by considering the reduction in entropy for 
all of the possible joint moves 
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AS = - 



J2P [t) (Ro = n) 



AS 



(t+i) 
{hi,n} 



x E E p(t) ( r o) p(t+1) (^' r '}i r o) 

hi,h 2 r 



(1) 



The first term in Eq. ([T]) corresponds to one of the 
searchers finding the source in the next time step (the 
final entropy will be S — so AS = —S). The second 
term considers the reduction in entropy for all possible 
measurements at the proposed location, weighted by the 
probability of each of those measurements. The proba- 
bility of the searchers obtaining the measurement {hi} at 
the location {r^} is given by the trace of the probability 
ri}|ro) over all possible source locations. 



CORRELATED STOCHASTIC SOURCE AND 
SYNERGY OF SEARCHERS 

The expected entropy reduction AS is calculated for 
joint moves of the searchers, that is, all possible com- 
binations of individual moves. Compared with multiple 
independent searchers this calculation incurs some extra 
computational cost. Thus, when designing a search al- 
gorithm, it is important to know whether an advantage 
(synergy) can be gained by considering joint moves in- 
stead of individual moves. Since the search is based on 
optimizing the maximum information gain we need to ex- 
plore if joint moves are synergetic or redundant. In this 
section we will show how correlations in the source affect 
the synergy and redundancy of the search. 

In the following we will assume there are no radial cor- 
relations between particles emitted from the source and 
that the probability of detecting particles decays with 
distance to the source. For each particle emitted from the 
source, the searcher i has an associated actual probabil- 
ity 7Tj(ro) of catching the particle. The probability 7Ti(ro) 
is defined in terms of a possible source location j"o and 
the location of searcher i: ^(ro) — B exp (— \fi — r~o| 2 ), 
where {r^} is the set of all the searcher positions and B 
is a normalization constant. Note that this is just the 
radial component of the probability; if there are angular 
correlations these are treated separately. We may now 
write R, as a function of the variables i?o, Hi, and P^, 
in terms of the conditional probabilities: 



R(Hi,H2, Ro) = 

P(r ,h 1 ,h 2 )log : 

h 1 ,h 2 ,ro 



P(/i 1 |r )P(/i 2 |r )P(/i 2 |/i 1 
P{h 2 )P{h 1) h 2 \r ) 



It is sufficient for R ^ that the argument of the loga- 
rithm differs from 1. This can be achieved even if mea- 
surements are conditionally independent (redundancy), 
mutually independent (synergy) , or when neither of these 
conditions apply. 



Uncorrelated signals: Poisson source 

First, consider a source which emits particles accord- 
ing to a Poisson process with known mean Ao so emit- 
ted particles are completely uncorrelated spatially and 
temporally. If searcher 1 is able to get a particle that 
has already been detected by searcher 2, it is clear that 
the searchers are completely independent and there is no 
chance of synergy. It may appear at first that imple- 
menting a simple exclusion where two searchers cannot 
get the same particle would be enough to foster coop- 
eration between searchers. We will instead show that it 
is the Poisson nature of the source that makes synergy 
impossible, even under mutual exclusion of the measure- 
ments. 

The probability of the measurement {hi} is given by 



P{{hi,n}\r Q ) = Po(h s ,\ )M({iri(r Q )},{hi},h s ). 

h 3 =J2i hi 

(3) 

The sum is over all possible values of h s , weighted by the 
Poisson probability mass function with the known mean 
Ao- M is the probability mass function of the multino- 
mial distribution for that measurement; it handles the 
combinatorial degeneracy and the exclusion. It is not 
difficult to show by summing over h s that P({hi, ri}\ro) 
can be written as a product of Poisson distributions with 
effective means Ao7r;, 



P({hi,ri}\r ) 



(2) 



i 

(4) 

At this point we consider whether a search like this can 
be synergetic for the 2 searcher case. Eq. (j4]) shows 
that the two measurements are conditionally indepen- 
dent and therefore P(/ii, h 2 \ro) = P(hi\ro)P(h 2 \ro)- It 
follows from Eq. © that R{H ll H 2 ,R ) = I{H ll H 2 ) > 0. 
Therefore the searchers are either redundant (if the mea- 
surements interfere with each other) or independent with 
respect to the source. Synergy is impossible so that 
searchers gain no advantage by considering joint moves. 
The only advantage of coordination comes possibly from 
avoiding positions that lead to a decrease in performance 
of the collective due to competition for the same signal. 
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R(H 1 ,H2,R )=I{H u H 2 )-I{H h H 2 \Ro) P(R ) 




FIG. 1: Synergy for the two searcher problem with angular correlations, (a) R(Hi, H2, Ro) as a function of the position of 
searcher 2 (r-2) for a fixed location of searcher 1 (ri, shown as a black star). The most probable source location is in the 
center (black dot). The white to blue scale indicates R = to R — —2 x 10~ 5 and we note that R < everywhere. The 
darker color indicates stronger synergy values when searcher 2 is near the source. The synergy is less when searcher 2 is away 
from or on the opposite side (R w 0) of the source, (b) The probability distribution of source locations, peaked at the center: 
P(i^o) = Aexp (— |ro| 2 /0.02), where A = Pi 7 ^) i s a normalization factor. White to blue indicates P — to P = 0.02. 

(c) /(.Hi, H2); (d) I{Hi, H2\Ro)- In (c) and (d) white to blue indicates J = 0to/ = 6x 10 _o . Contour lines have been added 
to guide the eye. In all frames the data is plotted in a two-dimensional spatial domain of x, y — [—0.5, 0.5] and all vectors are 
measured from the origin x = 0, y = 0. The parameter a 2 — 1.1 in Eq. \E\ 



Correlated signals: angular biases 

We now consider a source that emits particles that are 
spatially correlated. We assume for simplicity that at 
each time step the source emits 2 particles. The first 
particle is emitted at a random angle 9h 1 chosen uni- 
formly from [0, 2tt). The second particle is emitted at an 
angle 9i l2 with probability 

P(9 h2 \9 hl ) = Dcxp[-(\e hl -9 h2 \ -tt) 2 /<7 2 ] =f, (5) 

where D is a normalization factor. The searchers are 
assumed to know the variance a for simplicity; this is 
a reasonable assumption if the searchers have any infor- 
mation about the nature of the target (just as for the 
Poisson source they had statistical knowledge of the pa- 



rameter Aq). The calculation of the conditional prob- 
ability P({hi,ri}\r ) requires some care. Specifically, 
this quantity is the probability of the measurement {hi}, 
assuming a certain source position. Since there are 2 
particles emitted at each time step, there are 4 possible 
cases, each with a different probability, as shown in Ta- 
ble HI Here 9h 1 and 9h 2 are calculated from r\ and T2, 
respectively: 9y H = arctan ^ Q,y _^' ,y . Note that the 7r, are 
functions of ro. The coefficient D is chosen such that 
lEf, 2 Er 2 P{{huh 2 ,ri,r 2 }\ro) = P{{hi, n}|r ), cor- 
responding to the normalization condition ^2 r2 f = !• 
Figure Q] shows the value of R(Hi,H2,Ro) and 
the values of the mutual informations I(Hi,Pi2) and 
I(H±, H2I-R0) for each possible position r 2 of searcher 2. 
We assume a nonuniform, peaked probability distribu- 
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{hi,h,2} 


{1,1} 


{1,0} 


{0,1} 


{0,0} 


P({fci,n}|ro) 
P({h2,r 2 }\ro) 
P({h 1 ,h 2 ,ri,r2}\r ) 


7T2 

7ri7r 2 / 2 


7T2 

7ri/(l-7T2/) 


1 - TTl 
1 — 7T2 
71-2/(1 - TTl/) 


1-7T1 
1 — 7T2 
(l-7Tl/)(l-7T 2 /) 



TABLE I: Probability calculation for all possible states in the correlated source search. Here Jti(ro) = Bexp( — |r, — rh\ 2 ) is 
written as TTi to save space. 



tion for the source [Figure [IJb)] and that the position of 
searcher 1 is fixed. In this setup we see that R <= for 
every possible position of searcher 2 indicating that only 
synergy is possible. This is a consequence of the angular 
spatial correlation between the particles emitted by the 
source. The synergy is highest near the source location, 
where the source probability is strongly peaked, and falls 
off rapidly away from the source location. Furthermore 
there is little to no synergy near searcher 1 since in that 
region it is very unlikely that both searchers would simul- 
taneously observe a particle. The area of greatest syn- 
ergy corresponds to the most probable source locations 
for both searchers to simultaneously observe a particle. 
P(r ) is very fiat at the boundaries; thus i?o contributes 
little to I (Hi, H2\Rq) in the lower left corner and R is 
small. 



CONCLUSION 

In the real world, communication between agents, as 
well as centralized or decentralized real-time computa- 
tion can be difficult or expensive. Therefore it is impor- 
tant to consider the classes of search problems for which 
coordination between searchers can achieve quantitative 
advantages over independent agents. In this work we 
studied search algorithms for autonomous agents look- 
ing for the spatial location of a stochastic source. We 
defined the search problem for multiple agents in terms 
of infotaxis [see Eq. (JTJ]. We also showed why synergy 
gives rise to an advantage in this type of search. We 
considered two types of sources. We first demonstrated 
that a source emitting uncorrelated particles will afford 
no opportunity for synergy (see Section J . In a search for 
a Poisson source, multiple coordinated searchers (ones 
that consider sets of joint moves rather than each con- 
sidering an independent move) can not hope to do better 
than multiple independent searchers. Next we showed 
that, for a source emitting particles with (angular) cor- 
relations (see Section J , only synergy or independence 
is possible (see Fig. [lj . The ability of the searchers to 
leverage synergy depends strongly on their ability to esti- 
mate with some accuracy the probability distribution of 
source locations. These general considerations are cru- 
cial for the exploitation of social computation in terms of 
the design of optimal collective algorithms in particular 



applications. The next step to making this approach ap- 
plicable to a broader class of problems, including those 
not limited to spatial searches, is to generalize the results 
to more than 2 searchers and to explore how synergy may 
be best leveraged to give increases in search speed and 
efficiency. 

This paper is released under LA-UR 09-00432. 
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